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Abstract — We consider the multiple-access communication 
problem in a distributed setting for both the additive white 
Gaussian noise channel and the discrete memoryless channel. 
We propose a scheme called Distributed Rate Splitting to achieve 
the optimal rates allowed by information theory in a distributed 
manner. In this scheme, each real user creates a number of 
virtual users via a power/rate splitting mechanism in the M-user 
Gaussian channel or via a random switching mechanism in the 
Af-user discrete memoryless channel. At the receiver, all virtual 
users are successively decoded. Compared with other multiple- 
access techniques, Distributed Rate Splitting can be implemented 
with lower complexity and less coordination. Furthermore, in a 
symmetric setting, we show that the rate tuple achieved by this 
scheme converges to the maximum equal rate point allowed by 
the information-theoretic bound as the number of virtual users 
per real user tends to infinity. When the capacity regions are 
asymmetric, we show that a point on the dominant face can 
be achieved asymptotically. Finally, when there is an unequal 
number of virtual users per real user, we show that differential 
user rate requirements can be accommodated in a distributed 
fashion. 

Index Terms — Multiple access, rate splitting, successive decod- 
ing, stripping, interference cancellation, ALOHA. 



I. Introduction 

We consider the basic multiple-access communication prob- 
lem in a distributed setting. In Gallager's survey paper [1], 
it is pointed out that the multiple-access problem has been 
studied from a number of different perspectives, each having 
its own advantages and shortcomings. In the data networking 
community, a well-known distributed multiple access scheme 
is ALOHA [2], [3]. In ALOHA, it is assumed that a "collision" 
happens whenever more than one user transmit simultaneously. 
Those packets involved in a collision are discarded and re- 
transmitted according to some retransmission probability. The 
collision channel model, however, does not accurately describe 
the underlying physical multiple-access channel. It is well 
known that there exist coding techniques which can decode 
multiple users' messages when simultaneous transmissions 
occur. Indeed, more sophisticated models such as signal cap- 
ture [4], [5], spread ALOHA [6], and multi-packet reception 
[7], [8], [9] have been developed to enhance ALOHA. Even 
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these improved schemes, however, are not optimal from the 
viewpoint of information theory. In the information theory 
literature, the capacity regions of various multiple-access 
channel (MAC) models have been characterized (see [10], 
[11], [12], [13], [14], [15]). Rate splitting multiple-access 
techniques (or generalized time-sharing) are presented in [16], 
[17], [18], [19] to achieve every point in the Gaussian or the 
discrete memoryless MAC capacity region using only single- 
user codes. These schemes, however, require a pre-defined 
decoding order, which makes distributed implementation dif- 
ficult. Finally, in the spread spectrum community, CDMA 
techniques are adopted. Here, users are decoded regarding 
all other users' signals as interference. This, however, is not 
optimal from the information theoretic viewpoint. 

To address some of the shortcomings mentioned above, 
Medard et al. [20] use information-theoretic techniques to 
analyze different notions of capacity for time-slotted ALOHA 
systems. A coding/decoding scheme which combines rate 
splitting and superposition coding is constructed. This scheme 
allows some bits to be reliably received even when collision 
occurs, and more bits to be reliably received in the absence 
of collisions. Shamai [21] proposes a similar scheme to apply 
a broadcast strategy to multiple-access channel under static 
fading where the fading coefficients are not available to 
the transmitters or the receiver. To implement the scheme 
in [20], however, a pre-defined decoding order is required, as 
in [16], [17], [18], [19]. In [22], Cheng proposes a distributed 
scheme called "stripping CDMA" for the L out of K Gaussian 
MAC. Here, no pre-defined decoding order is required. It is 
shown in [22] that stripping CDMA is asymptotically optimal, 
although the optimal operating parameters are not specified. 

In this paper, we investigate distributed multiple-access 
schemes based on the idea of rate splitting for both the 
M-user additive white Gaussian noise MAC and the M- 
user discrete memoryless MAC. We characterize the optimal 
operating parameters as well as the asymptotic optimality 
of these schemes from the viewpoint of information theory. 
Assume that every user has an infinite backlog of bits to send, 
and that every user knows the total number of users M. We 
propose a distributed scheme, called Distributed Rate Splitting 
(DRS), to achieve the optimal communication rates allowed 
by information theory. In this scheme, each real user creates a 
number of virtual users via a power/rate splitting mechanism 
in the A/-user Gaussian channel or via a random switching 
mechanism in the M-user discrete memoryless channel. At the 
receiver, all virtual users are successively decoded. A possible 
advantage of the DRS scheme is that it can be implemented 
with lower complexity when compared with multiple-access 
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schemes such as joint coding and less coordination when 
compared with time-sharing and rate splitting. 

In Sections lITlandirrn we focus first on symmetric situations 
where the channel capacity regions are symmetric and every 
real user creates the same number of virtual users. In this 
case, the DRS scheme entails the following. Each user i 
creates L virtual users indexed by ik, k = 1,2, ...,L. The 
virtual user class 14 consists of users {1&, M&} (i.e. we 
have altogether L virtual user classes and there are M virtual 
users in each class). In the M-user Gaussian MAC, virtual 
users are created via a power/rate splitting mechanism. The 
signal transmitted by a real user is the superposition of all 
its virtual users' signals. The receiver receives the sum of 
the virtual users' signals plus noise. All virtual users are then 
successively decoded in increasing order of their class. That 
is, all virtual users in class k = 1, are decoded 

before any virtual user in Vj, where j > k, is decoded. In 
contrast to [22], the optimal operating parameters, such as 
power and rate, are explicitly specified for any finite L. In 
the M-user discrete memoryless MAC, virtual users with the 
same input distribution as the real users are created, and the 
transmitted signal of a real user is determined by a random 
switch. The receiver successively decodes all virtual users in 
increasing order of their class given the side information of 
already decoded virtual users. The optimal switch is found 
for any finite L for the 2-user case. Finally, it is shown that 
for both channel models, the rate tuple achieved by the DRS 
scheme converges to the maximum equal rate point allowed 
by the information-theoretic bound as the number of virtual 
users per real user tends to infinity. 

Next, in Section IIVI we consider more general situations 
where the capacity regions can be asymmetric and real users 
may generate different numbers of virtual users. For the case 
of asymmetric capacity regions, new operating parameters are 
specified for any finite number of virtual users per real user. 
We show that the DRS scheme still can achieve a point on 
the dominant face as the number of virtual users per real user 
tends to infinity. For the case of unequal number of virtual 
users per real user, we present a variation of DRS which 
supports differential user rate requirements in a distributed 
manner. In this new scheme, each user i, independently from 
other users, generates L; virtual users according to its own 
rate requirement. All virtual users are then decoded reliably 
at the receiver. Furthermore, as each real user generates more 
virtual users, the rate tuple achieved under this variation of 
DRS converges the maximum equal rate point on the dominant 
face. 

II. M-user Gaussian Multiple-access Channel 

We first examine a Gaussian MAC with a symmetric ca- 
pacity region. Later in Section IIVI we consider the asym- 
metric case. Consider an A/-user Gaussian MAC where each 
transmitter has transmission power P and the receiver has 

'The lower complexity comes from the fact that the DRS scheme uses 
single-user codes instead of multi-user codes. As we show later, the DRS 
scheme with a reasonable number of virtual users per real user allows us to 
get close to the optimal operating rates. 
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Fig. 1. Two-user Gaussian multiple-access capacity region, where the 
dominant face has been highlighted. 



noise variance N. The capacity region C is the set of R = 
(R U ...,R M ) e Mf satisfying 2 

Ri < \ (l + VS C {1, M} , (1) 

where \S\ is the cardinality of the set S. The dominant face 
T> is the subset of rate tuples which gives equality in Q for 
S = {1, ...,M}. For this symmetric setting, it is easy to see 
that the maximum common rate that every user can achieve 3 

i S E* = ^iog(i + ^n. 

It is well-known that rate tuples on the dominant face 
other than the vertices cannot be achieved via standard 
successive decoding [11]. Note that the optimal rate tuple 
R* = (R* , R*), called the maximum equal rate point, is 
such a point. For the two-user Gaussian MAC, the maximum 
equal rate point is shown in Fig. \l\ Currently, three methods 
are known to achieve general points on the dominant face: 
joint encoding/decoding, time-sharing, and rate-splitting. Joint 
encoding/decoding is not practical because of its high com- 
plexity [1]. In time-sharing, all M users need to coordinate 
their transmissions. Therefore, some communication overhead 
is required. The rate-splitting method in [16] achieves every 
point in C via a generalized successive decoding scheme. For 
the two-user case, user 1 creates two virtual users, say la 
and 16, by splitting its power P into S and P — 6 and setting 
r la = |log(l+ 2P _* i+JV ), rib = |log(l + ^). User 2 does 
not split its power and sets its rate to i? 2 = | log(l+ p _$ +N )- 
The decoding order is (la, 2, 16). In order to achieve the 
maximum equal rate point, we solve i?2 = r\ a + ru, yielding 
S = |(JV + 2P - y/N(N + 2P)). Thus, both time-sharing 
and rate splitting require some coordination among users. 

In this paper, we focus on distributed multiple-access 
communication schemes. In particular, we introduce the Dis- 
tributed Rate Splitting (DRS) scheme. The DRS scheme offers 
the possibility of multiple-access communication with lower 
complexity when compared with joint coding, and communi- 

2 We use R to denote (Ri, Rm) throughout. 

3 R is achievable if for any e > 0, there exists an (n, -Ri —£,..., Rm — e) 
multiple-access code with overall error probability P e < e, where n is the 
block length. 
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Fig. 2. Comparison of rate splitting with distributed rate splitting. In the 
right-hand figure, the virtual user class Vi = {11,21} is decoded before 
virtual user class Vi = {12,22}. 



cation with less coordination when compared with the time- 
sharing or rate splitting method. Moreover, we show that 
DRS can achieve the maximum equal rate point of the MAC 
capacity region asymptotically. 

We now formally present the DRS scheme. In this scheme, 
each user creates L virtual users by splitting its power P 
into (pi,p2, ...,pl), where pk is the power allocated to the 
fcfh virtual user and Ylk=i Pk = P- Each user then assigns 
transmission rate to virtual user k. Note that the proposed 
DRS scheme is symmetric, i.e. all M users split their powers 
and set their rates in the same way. The signal transmitted 
by a user is the superposition of its virtual users' signals. As 
defined in Section |I] virtual user class Vk consists of all virtual 
users indexed by fc. The receiver receives the sum of all virtual 
users' signals plus noise. All virtual users are then successively 
decoded in increasing order of their class. 

To illustrate the DRS scheme, consider the case L = 2. 
Each real user splits its power P into S and P — S. Notice 
there are two major differences between our scheme and the 
traditional rate splitting scheme in [16]. First, in our scheme, 
all real users split in the same way, whereas there is at least one 
user who does not split in the traditional rate splitting scheme. 
Second, virtual users in the same class, (i.e. with the same 
index fc), are allocated the same rate in our scheme, whereas all 
virtual users have different rates according to the pre-defined 
decoding order in the traditional rate splitting scheme. 4 These 
differences are illustrated in Fig. |2 

Since we assume the receiver uses successive decoding 
method, some virtual user must be decoded first. Without loss 
of generality we assume one of the <5 virtual users is decoded 
first. For the case L = 2, we show that there is a unique way 
for a real user to split its power in order to maximize its total 
throughput. 



Lemma 1: For L = 2 and for a fixed 5, each real user's 
throughput is maximized by setting n = -| log(l + MP _ S g +N ) 
and r 2 = \ log(l + (M _ 1) ^p^ )+jv ). 



4 In terms of achievable rate, the DRS scheme with L = 2 is not optimal. 
Later in this section, we demonstrate the asymptotic optimality of DRS by 
taking L to infinity. 



Proof: The 6 virtual user who is decoded first must have 
r\ = \ log(l + MP S _ S+N ) (i-e. the virtual user regards all 
other virtual users as interference) in order to be decoded 
successfully. Due to symmetry, all other 5 virtual users must 
have the same r%. Then the problem of maximizing each 
real user's throughput reduces to maxr2, subject to (i) r\ = 
I log(l + MP 5 _ S+N ), (ii) one of the S virtual users is decoded 
first and (iii) (r\ , r%, r\ , r\ , r%) must be decodable. 

Note that r 2 is maximized when the interference plus noise 
faced by all the (P — 6) virtual users is minimized, and the 
only way to minimize the interference plus noise faced by all 
the (P — S) virtual users is to decode all the 6 virtual users 
before decoding any (P — S) virtual user. 5 Therefore, the 
minimum interference plus noise faced by any (P — 5) virtual 
user is MP - MS - (P - 6) + N = (M - 1) (P - 6) + N. 
Hence, the maximum rate associated with a (P — 6) virtual 
user is r 2 = ± log(l + (M _^;£ i)+JV ). □ 



Using the DRS scheme with L = 2, each user can strictly 
increase its throughput relative to the case where users do not 
split their powers and decode against each other as noise. This 
is easily verified by observing that for any S < P, 



log 1 



MP -S + N 

> log ( 1 



log 1 



P-S 



(M -1)(P-S)+N 
" ■ (2) 



(M- 1)P+ N 

Now consider the case where each user creates more than 
two virtual users (L > 2). Here, we show that each user's 
throughput increases further. 

Lemma 2: Given a DRS scheme with L virtual users per 
real user, where are the virtual users' powers, it 

is possible to strictly increase the throughput via an (L + 1) 
virtual user system with powers (pi, —,Pl-i,Pl,Pl)> where 
Pl +Pl = PL- 
Proof: Suppose that every user splits its power into L virtual 
users: (pi,p 2 , -,Pl-i,Pl) subject to Y,k=iPk = p > where L 
is an arbitrary integer and pk is the power of fcth virtual user. 
Since virtual user L is decoded last, following the reasoning in 
the proof of Lemma 1, we have rj, = \ log(l + (M-i)p L +N ^' 
We now split the virtual user with power pj^ into two new 
virtual users with powers p L and p L , where p L + p L = Pl- 
We set 



ilog[l+ 

2 y Mp L -p L 



N 



1 



Pl 



{M-l)p" L + N 



Now each real user has L + 1 virtual users. Notice that we 
do not change the power and decoding order of any of the 
other virtual users (i.e. virtual users 1, . . . , L — 1). From a real 
user's view point, the virtual user with r L > is decoded second 

5 We assume a genie-aided [16] decoding scheme where the previously 
decoded messages have been decoded correctly. In practice, errors can be 
made in previous decodings. However, for purposes of analyzing the overall 
error probability, the genie-aided model is sufficient. 
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to last among all virtual users generated by this real user 
and the virtual user with r L » is decoded last. Thus, all virtual 
users can be decoded and from (0, r L > +r L » > rr,. Therefore, 
every real user with L virtual users can strictly increase its 
throughput by splitting its power among L + l virtual users. □ 

Before we examine the asymptotic behavior of DRS, we 
solve the problem of how to split a user's power optimally 
among a fixed number of virtual users. The main difficulty 
here is that the objective function is not concave. In order 
to find the optimal splitting method, we prove the following 
lemma. 

Lemma 3: Consider the following optimization problem: 



user k and k + 1 are decoded at the kth and (k + l)th places 
respectively, and r k (pi, ...,p L ) ^ r k+1 (p 1 ,...,p L ). 

Without loss of generality, let us consider the case where 
r k (pi, ...,p L ) > r k +i (pi, ...,p L ). By the definition of r k , we 
have 



Pk 



MP-MZ 1<k Pj-Pk + N 



> 



Pk+i 



MP- M £\ <fc Pj - MPk - Pk+i 



N 



(4) 



We can verify that if we change p k to p k — e and p k +i to 
Pk+i + £, where e is a small positive number, then the first 
term of @ decreases and the second term of (0} increases. 
Let e* be the solution to 



max -log 1 + 

Pk,Pj l \ A—p k 



5 log(l 



pj 



A - Mpk - pj 



Pk 



(3) 

subject to p k +pj = c and p k ,pj > 0, where A, M 
and c are positive constants and A > Ale. The unique 
solution to is also the unique solution to A-p k = 

A-Mvk-vj ' sub J ect t0 Pk + Pj = c and Pk,Pj > 0, where 
A > Me.' 

Proof: Substitute pj = c — p k into the objective function, 
we have 



fiPk 



1 i ft , P k 

2 l0 H 1 + ^ 



1 



"2 lo e ( 1 



Pk 



A - Mp k — (c - p k ) 



Setting d ^}p^ - — subject to < p k < c, the unique 
solution is pi = jj(A - y/A(A - cM)). Thus, p* k is the 
unique stationary point of / (p k )- We can also verify that 
f{pl) > /(0) and f(p* k ) > /(c). So (pj.c-pj) is 
the unique solution to our maximization problem. We can 
directly solve = A _ A ^ k _ p . subject to p k +p 3 =c and 

Pk,Pj > 0. The unique solution is also (p^,c — □ 



We now present the optimal splitting method. Theorem ^ 
states a necessary condition for the optimal splitting method, 
and Theorem [2] implies there is a unique optimal splitting 
method. In Corollary ^ we formally present the optimal 
splitting method and the required power levels. 

Theorem 1: Let each real user split its power into L virtual 
users. Let p k be the power allocated to the fcth virtual user 



and r k = ~ log (1 + 



_£k_ 



0- If (Pi,-Pl) 



MP-MZ j<k Pi-Pk+Nl 

maximizes ^2 k=1 r k and satisfies Ylk=iPk = P> P*k — ^ ^ or 
k = 1, 2..., L, then r k (p*, ...p* L ) = r*, for all k. 

That is, the optimal power split must lead to equal transmission 
rates for all virtual users. 

Proof: We use a perturbation argument. Suppose (pi,-..,Pz,) 

maximizes Ylt=i Tk and sa ti s fi es Y^k=iP~ k ~ P> P~ k — VA: 
and the resulting r k (pi, ■■■,Pl) is not the same for all fc. Then 
we can find a pair of virtual users (k.k + 1), where virtual 



MP-MY, 1<k P 3 



(p k -e)+N 
Pk+l + £ 



MP-M V - <fc ^ - M (p fc - e) - (pfc+i + e) 



iV 



(The existence of e* can be demonstrated). Let 
Pk = Pk - £* and p k+1 = p k+1 + e* . Notice that 
Pk + Pk+i = Pk + Pk+i- Since the maximization 
considered in Lemma has a unique solution, 
r k (pi, ...,p k ,p k+1 , ...,Pl) + r k+1 (pi, ...,p k ,p k+ i, ...,p L ) > 
r k (pi,...,p k ,p k+1 ,...,p L ) + r k+ i(pi,...,p k ,p k+1 ,...,p L ). 
This contradicts our assumption that (pi, ...,Pl) maximizes 



J2k=i r k- Therefore, the theorem follows. 



□ 



By Theorem n if (pt, ■■■,Pl) maximizes X)fc=i rfc an< ^ 
satisfies J2k=iP*k = p > P*k ^ for k = 1,2...,L, then 
we must have SIR X (p\, ...,p* L ) = ... = SIR L (jp\, ...,p* L ) 



where SIR k (p u ...,p L ) 



Therefore, 



MP-MT. J<k Pj~P k +N- 

if we show that SIR k (pi, —,Pl) = SIRj (pi, —,Pl) for 
all k 7^ j, has a unique solution, then there is at most one 
feasible solution to the maximization problem. 

Theorem 2: The set of equations: SIRi (p%, ...,pl) = ■■■ = 



SIR L (pi, ...,p L ), subject to J2 k =iP k 
has a unique solution. 

Proof: See Appendix I. 



P and p k > Vfc, 



Corollary 1: If a real user splits its power P into L virtual 
users, then the unique way to maximize this user's throughput 
istosetp fc =f (l+^)^[(l+^)i-l]forfc = l,...,L. 

Proof: Since the constraint region {p : 2^2k=iPk 
I' and j ik; > for A; = 1,2,..,L} is a simplex and 
Efc=i r k is continuous, there exists at least one solution. 
We denote one solution by (p\, ...,pl). By the necessary 
condition stated in Theorem ^ (pi,--,Pl) must satisfy 
n(pi,...,p L ) = ... = r L (p 1 ,...,p L ). Moreover, by the 
uniqueness property stated in Theorem 13 (pi, ...,Pl) is 
the unique solution to rnax Pl) .. lPi 2~2k=i r k subject to 
2^2k=iPk = P andpt > Vt Next, we plug p k into the 
expression of SIR k (p±, ...,pi)- Let A = 1 + ^jf-, we are 

able to verify that SIR k (pi,..-,Pl) — — AT \ — , which 

(M-1)A~+1 
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is independent of k. Hence, the corollary follows. 



□ 



We now examine the asymptotic behavior of the DRS 
scheme. We first demonstrate the interesting fact that the rate 
tuple converges to the maximum equal rate point for a general 
power split as long as all virtual users' powers go to as 
L — > oo. This implies a convergence result for the optimal 
power split. We then analyze the rate of convergence under 
the optimal power split. 

Theorem 3: Given any power split (pi,...,pi), a suffi- 
cient condition for lim i _, 00 2~2 k =i r k = ^ log(l + ^f-) is 
m.ax. k& [ li ... >L yp k -> as L -v oo. 



Proof: 



> 



L 

lim }r k 

k=l 

lim > — log 1 

fe=i \ 

lim — [ 

k=l \ 

lim — ( — 

k=l \ 

L 1 

lim > — 



Pfc 



MP-ME i<fc Pi-P*+JV y 



MP-MJ2 J<k p J - Pk + N / 

Pk \ 

MP-Mj2 1<kPj +N 



Pk ~ 0k- 



*<-°°~ 2 \MP + N -Mfik-i 



1 



1 



2 7 MP + N-Mx 

1 . 
2M 



-da; 



1 / MP\ 

:l0g(l + — J 



iV 



(8) 
(9) 



where /3 = 0, /?* = X)j =1 Pi. 

The equality in (|5j is justified as follows. Note that, 
linx^o l2Sdj^lnS — — I. Hence, for sufficiently small posi- 
tive 6, \x\ <6=> \ los{1 + 2 x) ~ x \ < 1 => |log(l + x) -x\ < x 2 . 
Now, we examine the error term 



< 



E 

k=i 



E 

fc=i 



log 1 



Pfc 



Pk 

MP-MJ2 1<k Pj-Pk+N , 



log 1 



Pfc 



MP .\/V. /'/ • n 

Pk 



< 



< 



E 



MP-MY, j<k Pi-Pk + N ; 
Pfc \ 



N 



fc=l 



Pk 



(10) 
(11) 



< 



1 



L 
k=l 



P 



maxpk 

k 



where inequality in 



holds 



(12) 



(13) 



because 



Pk 



MP-MZ j<k Pi-Pk+N 

in (^J follows from the fact that 



< S when L — > oo, and the inequality 



- AT ■ 



Since maxj. pt; — > as L — > oo, the error term goes to zero in 
the limit. This justifies the equality in 0. Using the capacity 
bound, we also have lim, £ ,_ 00 Y,k=i r ^ < 237 ^sC 1 + t)' 



Therefore, linu^ £ fc=1 ^fc = 537 ^sC 1 + tF) 



□ 



Note that our optimal power split satisfies the sufficient 
condition in Theorem[3] Therefore, its convergence is assured. 



Corollary 2: If each real user adopts the optimal splitting 
method specified in Corollary ^ then 



L 1 
lim > ri. = log ( 1 

k=l 



N J 



Next, we examine the rate of convergence to the maximum 
equal rate point under the optimal power split. Define the error 
term e[L] = R* — Y^k=i Tk > we ana ly ze now f ast this error 
term tends to as L — > 00. We prove the following: 6 



Theorem 4: e [L] = 9 (£) 
Proof: Let A = 1 



MP 
N ■ 



lim Le [L] 

L — >oo 



■log 



M 



M-l + A-t 



lim 



lim 

2/^0 



2M 



|log( 



M 



M-l+A-» 



2M 



2/ 

1 A"" log(A) 

2 M-I+A-b 



22/ 

(M-l)(logL4)) 2 
4M 2 



(14) 



(15) 



(16) 



Note that equalities in d!5l > and H6i can be verified by 
L'Hospital's rule. 

Consequently, given any e > 0, there exists a pos- 
itive integer n such that for all L > n , we have 
< e. This implies 

Therefore, we can choose 
- £ > 0. Let 
e, we have 



Le[L}-^ 
e < Le [L] < 

a small enough e such that 



Cl 



_ (M-l)(log(A)) 



l)(logW)' i 

(M-l)(log(A)y 
4M 2 

_ £ C2 = (M-l)(log(A)) 2 



-l)(log(A)) 2 



4M 2 c ' u ^ 4Af 2 

ci < Le[L] < C2- This implies that there exists a positive 

6 Recall that / [n] = f2 (g [n]) if there exist positive constants c\ and no 
such that f [n] > cig [n] for all n > no, and f[n] = 0(g[n]) if there 
are positive constants C2 and no, such that f[n] < C2#[n] for all n > no- 
Finally, f[n] = 6 ( S [n]) if f[n] = Q (g[n]) and f[n] = O (g[n]). 
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100 real users and P/N = 100 



where X s 4 and S c 4 {1, M } \ S. 

The capacity region of the asynchronous MAC is [14] [15] 



C = 



|J K{W;P Xl ---Px A 



(17) 



5 0.6 - 



■x- Distributed rate splitting 
- ■ No splitting: regard other users as m 
-0- Centralized scheme 



Number of virtual users 
100 real users and P/N = 0.01 



■ ■"■ Distributed rate splitting 
- No splitting: regard other users as n< 
-&- Centralized scheme 



Number of virtual u: 



Fig. 3. Throughput per real user v.s. the number of virtual users per real 
user for both high and low SNR regimes. Note that the scales of the vertical 
axes in both figures are different. 



We fix the input product distribution Px x • • ■ Px M 
and focus on achieving the desired operating point in 
7£[W; Px x • • • Px M ]- In this section, we consider only 
discrete memoryless channels satisfying the following 
symmetry condition: 



I(X s ;Y\X S c) = I(X T ;Y\X TC ). 



(18) 



V5,T C {1, ...,M} such that \S\ = \T\. Later, in Section HVl 
we consider the more general asymmetric case. We further 
assume that for VS 1 , T C {1,2, ...,M}, if S n T = 0, then 
I (Xs; Y) < I (Xs; Y\Xt). Under our symmetric setting, the 
maximum common rate that every user can achieve is R* = 
jjl (X%, ...,X M ; Y). 

In the Gaussian MAC, virtual users are created via a 
power/rate splitting mechanism. For the discrete memoryless 
MAC, we adopt the random switching mechanism of [19] 
where virtual users with the same input distribution as the real 
users are created and the transmitted signal of a real user is 
determined by a random switch. We first consider the two-user 
discrete memoryless MAC (M = 2), and illustrate the random 
switching mechanism. The optimal random switches and the 
asymptotic behavior of DRS under the optimal switching are 
presented. We then examine the Af-user case (M > 2), 
and present a sufficient condition for the random switching 
mechanism to converge to the information theoretic upper 
bound. Finally, we investigate the rate of convergence for a 
simple suboptimal random switch. 



integer no and for all L > no, we have ^ < e [L] < ^. 



□ 



Finally, we note that all virtual users in one virtual user 
class can be decoded in parallel. Thus, the decoding delay 
of DRS is proportional to the number of virtual users L and 
independent of the number of real users. Since L is controlled 
by the designer, DRS offers a tradeoff between the throughput 
of a real user and the decoding delay. In Fig. |5J we present 
some numerical simulations illustrating the tradeoff between 
the number of virtual users and the throughput for both the 
high and low SNR regimes. A system with 100 real users is 
used in the simulations. 

III. M-user Discrete Memoryless MAC 

An M-user discrete memoryless MAC is defined in terms 
of M discrete input alphabets Xi, i £ {1, M}, an output 
alphabet y and a stochastic matrix W : X± x X% x • • • x 
%m y with entries W (y | Xi, Xm)- For any prod- 
uct input distribution Px ± ■ ■ ■ Px M , let the achievable region 
K[W; P Xl --- Px M ] be the set of R G satisfying 



ies 



R % <I(X S ;Y\ X S c),V5C{l,...,M} 



A. Two-user Case (M = 2) 

Consider a two-user MAC, W : X\ x X 2 — > y. For a fixed 
input product distribution Px 1 Px 2 7 the achievable region is 
given by: 

Ri < I(X 1 ;Y\X 2 ) = I(X 1 ;Y,X 2 ) 
R2 < I(X 2 ;Y\X 1 ) = I(X 2 ;Y,X 1 ) 
Rx+Ri < I(X 1 ,X 2 ;Y). 

Under our symmetry assumption (cf j!8t). we have 

I(X X -Y) = I(X 2 ;Y), I(X X -Y,X 2 ) = I(X 2 ;Y,X 1 ), 
I(Xi;Y, X 2 ) > I(X 1 ;Y), and the optimal rate tuple is 



(/,'./,') = ( ^I(X 1 ,X 2 ;Y),^I(X 1 ,X 2 ;Y] 



(19) 



Let us consider the random switching mechanism for this 
channel. We first consider the case where each real user 
generates two virtual users. Later, we consider the case where 
the number of virtual users per real user goes to infinity. We 
split by means of two switches, as shown in Fig. |4] Each 
switch has two inputs, Xn £ Xi and Xq G Xi and one 
output Xi G Xi. Switch i is controlled by a random variable 
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S,=1,2 



X,1 
X 1? 



Switch 1 



MAC 



Switch 2 



> Y 



► So 



Sj=1,2 



Fig. 4. Switches for two-user discrete memoryless MAC 



Si G {1,2} with P(5j = 1) = A. The output is given by 
= X a if 5i = 1, and X l = X i2 if $ = 2. 

The switching random variables {Si, $2} are independent 
of the channel inputs. We also assume that {SijS^} are 
available at the receiver. In practice, one would generate 
Si and S2 at the transmitters and at the receiver, e.g. by 
means of a pseudorandom sequence generator. Assign to 
the channel inputs Xn, Xyi, X 2 \ and X 2 2 the proba- 
bility mass function Px lu x 12 ,x 2U x 22 (^11, £21, £22) = 
Px 1 (xu)Px 1 (xi2)Px 2 (x2i)Px 2 {x22). Notice that X. a and 
X12 are independent and each has the same probability mass 
function as the random variable Xi for i = 1, 2. 

In successive decoding for the discrete memoryless MAC, 
the signals of decoded virtual users are used as side informa- 
tion to aid the decoding process of subsequent virtual users. 
The first constituent decoder observes the output {Y, S%, S2} 
and tries to decode Xn and X21. The second constituent 
decoder is informed of the decision about {Xn, X 2 i} made 
by the previous constituent decoder and tries to decode X12 
and ^22- Without loss of generality, let us focus on real user 1. 

r Xll = I(X n ;Y,S 1 ,S 2 ) 
= I{X n ;Y,S 2 \S 1 ) 
= \I(X 11 ;Y,S 2 \S 1 = 1) 

+ (1-X)I(X 11 ;Y,S 2 \S 1 = 2) 

= xi{x 1 -y) 

where the second equality follows from the independence 
between Xn and Si, and the last equality follows from the 
fact that when Si = 2, Xn is independently of the output Y 
and S2. Similarly, we have 

rx 12 = I(Xi2',Y,Si,S 2 ,Xn,X 2 i) 

= (1 - A) [XI(Xi;Y, X 2 ) + (1 - A)/(Xi; Y)] . 

It can be verified that in the two-user discrete memoryless 
MAC, both real users' throughput can be strictly increased by 
splitting their inputs via a random switch, relative to the case 
where they do not split, (i.e. rx lt + r Xl2 > I(Xx',Y) for 
A G (0, 1)). Next, we show that by generating more virtual 
users, the throughput of each real user increases further. 



Lemma 4: For M = 2, consider a distributed rate splitting 
scheme with L virtual users per real user. The random switch 
for user i is controlled by Si, where P(Sj = k) — Xk for 
k = l,...,L. It is possible to strictly increase the throughput 
via an {L + 1) virtual user system by splitting the Lth virtual 
user into two virtual users. 

Proof: Without loss of generality, we consider user 1. For 
the fcth virtual user, we have 

rx xh 

= I (Xik] Y, Si, S 2 ,X\\, X 2 i, ...,Xi(fe_i), X2(fe_i)) 
= I (Xik; Y, S 2 , Xn, X 2 i, 

Xi(k-i),X 2 (k-i) I Si) (20) 
= Xkl {Xik', Y, S 2 , Xn, X 2 i, 

X\(k-i)i X 2 (k-i) \S\=k) 
+ (l-X k )I(X lk ;Y,S 2 ,X n ,X 21 ,..., 

Xi(k-i)iX 2 (k-i) I Si ^ fc) 
= Xkl (Xik; Y, S 2 , Xn, X21, 

Xi(k-i),X 2 (k-i) I Si = fc) (21) 



= Xi 



= x k 



^ Xj I I (Xikl Y, X\\, X 2 \, 
K i<h ) 

Xi(k-i) i X 2 (k-i) Si = fc,S 2 < fc) 

1 — Xj I / {Xik, Y, Xn, X 2 %, 
j<k J 

Xi(k-i),X 2 (k-i) Si = fc,S 2 > fc) 
^Aj ■)l(X 1 ;Y,X 2 ) 



\3<k 



1-^A, ] I(X i; Y) 

j<k 



(22) 



where equality in (I20> is due to the independence between 
X\k and Si, and equality in (12 1 1 follows from the fact that 
when Si ^ fc, X\k is independent of the output Y and all the 
other random variables. Finally, equality in (I22t holds because 
when S2 < fc, one of the random variables X21, ...,X 2 n.^i\ 
is the switch output, and when S2 > fc, none of them is the 
switch output. Therefore, 

r XlL = X L [(1 - X L ) I (X i; Y, X 2 ) + X L I (X i; Y)] . 

Now let us split rx XL into r x i and r X 2 by using a switch 
controlled by a binary random variable S^with P(S' = 0) = 
a. We have 

r xL = aX L ((l-X L )I(X i; Y,X 2 ) + X L I(Xr,Y)), 
r X 2 iL = a\ L ((l-a\ L )I(X 1 ;Y,X 2 ) + a\ L I(X 1 ;Y)) t 

where a = 1 — a. Hence, 

r x 1 + r x 2 ~~ r x 1L 
= aX L ((1 - \ L ) I {Xi;Y, X 2 ) + X L I (X i; Y)) 

+aX L ((1 - aX L ) I (X i; Y, X 2 ) + aX L I (X\;Y)) 
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-A L [(1 - A L ) / (Xi ; Y, X 2 ) + \ L I (Xi;Y)\ 
= aaA|[/(X i; y,X 2 )-7(X i; F)] 
> 

with strict inequality if a 6 (0, 1). 



□ 



Before we examine the asymptotic behavior of the DRS 
scheme for M = 2, we first solve the problem of how to find 
the optimal switches for a fixed number of virtual users per 
real user. 

Theorem 5: For M = 2, if a real user has L virtual users, 
then the optimal random variable to control the switch for user 
i is Si e {1, L} with P(5j = k) = \ for k = 1, L and 
i = 1,2. 

Proof: We use a perturbation argument. Suppose the random 
variables Si.Sa e {1, ...,£} with P(5i = ft) = P(S , 2 = 
ft) = Afe maximize ifoi, where Afc > and J2k=i ^ k = 
Moreover, suppose there exists Afc such that Afc 7^ j;. Let Afe 
be the first element which is not equal to ^. We consider the 
pair (A fe , A fe+ i). We have 

r lk = X k (^^I(X i; Y,X 2 ) 

+ \l- k -^)l{Xr,Y) 



r i(fe+i) — Afe + i 



L 



X k )I(X 1 ;Y,X 2 ) 



+ (i-^-A fc ) J(x i; r) 



Therefore, 

rik + ri( k +i) 
(Afe + Afe+i) 



k-l 



+ 



(Afe + Afe+i) 



L 

L-k 



+ AfeA fe+1 
1 



I(X 1 ;Y,X 2 ) 



— AfeA 



fcAfc+i 



7(X i; F). 



Theorem 6: For M = 2, if both real users adopt 
P(Si = k) = 1 for k = 1,...,L and i = 1,2, then 
lim^ooELi^ = \I(X U X 2 ;Y) = R* for i = 1,2. 
Moreover, if we define the error term e[L] = i?* — fx ifc > 
then e[7] = 6(^) for i = 1,2. 

Proof: Without loss of generality, we consider real user 1. 
Since 



rx lk = z 
we have 



ll( Xl ;Y,X 2 )+(l-- 



V 



lim Rx x 

L — >oo 

lim — 

L— -'oo Jj 

L 



+ 



L 



lim 

L— >oo 



L 
L + l 
2L 



1 

+ L + - 
+ ... + ■ 

I(Xi;Y) + 



L J 
I(X 1 -Y,X 2 ) 
L - 1 



I{Xi;Y) 



2L 



I{X i; YX 2 ) 



= -[/(x i; y) + 7(x i; y,x 2 )] 
- l/(Xi,x 2; y), 

where the last equality follows from the fact that 
I(Xi; Y, X 2 ) = I(X 2 ; Y, Xi) in the symmetric setting. 

Next, we examine the rate of convergence. We have the error 
term e[L] = \l(Xi;Y) + \l(Xi;Y,X 2 ) - (^tl/(X i; F) + 



^-I(X 1 ;Y,X 2 )). Thus, 



e[L] = —(I(X 1 ;Y,X 2 )-I(X 1 ;Y)), 
which implies 

lim Le[L] = \ (I(Xi;Y,X 2 ) - I(X 1 ;Y)) 4 £. 

L^oo Z Z 

For any £ > 0, there exists an no such that for all L > no, 



\Le[L] 



< e. Hence, § — e < Le[L] < % + s. We can 



First, we consider the case where A fe > A fe+ i. We let A fe = e[L] = Q(j;) 
; - e and A fe+ 

hk +h(k+i) 



choose e small enough such that 



e > 0. This implies 

□ 



Afe - e and A fe+ i = A fe+1 + e for e < Xk 2 Afc+1 . We have 



k — 1 

(Afe + Afe+i) — h (Afe - e) (Afe+i + e) 



+ 



L — k + 1 

(Afe + Afe+i) (Afe - e) (Afe+i + e) 



I(Xi;Y,X 2 ) 
I(Xi;Y). 



Thus, fife + fi(fe + i) - (rife + ri( fe+ i)) = [(Afe + Afe+i) e 
-e 2 ] (I(X 1 ;Y,X 2 )-I(X 1 ;Y)). Notice that the second term 
of the R.H.S. expression is positive and there exists e such 
that ((Afe + Afe+i) e-e 2 ) > 0. This, however, contradicts our 
assumption that the random variables Si,S 2 G {1,...,L} 
with P(5i = k) = P(S 2 = k) = X k , maximize R Xl - We 
obtain similar contradictions for the case where Afe < Afe + i. □ 

We now examine the asymptotic behavior of the DRS 
scheme in the two-user discrete memoryless MAC. 



B. M-user Case (M > 2) 

There are M real users and each real user creates L virtual 
users. We have M switches (Si, Sm) to do the splitting 
with probabilities P(Si = k) = \ k for i = 1,...,M and 
k = 1, L. We assume the receiver also knows (Si, Sm). 
This may require common randomness to exist between all 
transmitters and the receiver. Due to symmetry, we focus on 
one user, say user 1. For k = 1,...,L, we set 



rx lk 



= /(Xife;y,sf,xir^...,x^) 

= I(Xi k ;Y,S? 1 X\t 1 \---X 1 t 1) \S 1 ) 



(23) 
(24) 



— X k I(Xi k ; Y, S^, \...,X M \ ; | •S'i — A;) 



+ (l-X k )I(X lk :Y,S 2 vl ,X 1 1 \ 



M(k-l) 
Ml 

M Y l(fe-1) 
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r M(k-l) 



Xi k ;Y, 
X k I(X 1 ;Y 1 X 1 1 [ k ' 1) 



Afei(Aife, J,» 2 , A n ,...,A M1 



X j ;r _ ^ I Sx = k) (25) 



X^*- 1 5|5 1 =jfe s S^) 



' ■■■i^Ml 



P(S2 = s 2 , S M = s M ) A fe J(X i; Y,X^ 



,X^f ^ |5i — fc, 52 — S2, >?m — sm) 



i(fe-i) 



M-l 




Y, X2, ^"j+ij 



(26) 



where = {5,,..,^} and Xg = {X a , ...,X ife }. Equality 
in ( I24> is due to the independence between X\k and S\ . 
Equality in (125 \ holds because when Si ^ fc, is inde- 
pendent of the output Y and all the other random variables. 
The first term in (I26> follows from P(S < 2 > k,...,S_M > k) 
The second summation term in (I26> 



M-l 



follows from the fact that the probability of i switching random 
variables among (S2, Sm) having values less than k is 
{ M i l ) (E J<fc ^) l (l-E J<fc \) M - 1 - i - It can be verified that 
real user 1 with L virtual users can strictly increase its total 
throughput via an L + 1 virtual user system. 

In order to maximize the total throughput of real user 1 for 
fixed L, we need to find the optimal (A^, AJ) to maximize 
Efc=i r -fifc- This is a non-convex optimization problem and 
appears to be difficult. We are able to verify that for the general 
M-user case (unlike the two-user case), random switches with 
a uniform distribution are in general suboptimal. Nevertheless, 
it is possible to generalize the asymptotic result of Theorem|6] 
We first demonstrate the fact that the convergence result holds 
for a general switch controlled by Si, where P (Si — k) = Afe 
for k = l,...,L, as long as max fee { lj L \ Afe — > as L — > 
00. We then analyze the rate of convergence for a particular 
suboptimal switch, the uniform switch. 

Theorem 7: For a general random switch controlled by 
Si, where P(Si = k) = Afe for k = 1,...,L, a sufficient 
condition for lim L ^oo J] Li fx ifc = jjl (Xi, X M ) Y) is 
maxfegjj l} Afe — > as L — > 00 for i = 1, M. 

Proof: Without loss of generality, let us examine real user 1. 



lim Rx 1 

L — *oo 



= lim J2r Xlk 

k=l 
L 

= lim V^Afc 

k=l 




M-l 



I(Xi;Y) 



M-l 

E 



'M - 1 



j<k 




I(Xi;Y,X 2 ,...,X i+1 ) 



M-l 



= lim cJi 



L — >oo 

where 

1 = I{X i; Y) 

11 = I(Xi;Y, X2, Xi + i) 

k=l 
L 



M-l 



CO 



= EM 



k=l 




M-l-i 



for i > 1. 

It is sufficient to prove lirriL^oo c, = jj for all i. For i > 1, 



lim Cj 

L — >oo 



M-l-i 



lim N Afe 
r , m ^ — ' 



k=l 
L 



M - V 



EM h-E^ 

,i<fc / \ j</c 



fc=l 



(M-l 



B(i + l,M-i) 



(M-l)! i\(M-i-iy. 



i\(M-i- 1)1 
1 

M ' 



M! 



where /3 = 0, /3 fc = X^ =1 A fc and B(m,n) = ( " m ^ ( " 1} } )! 
is the beta function. The term cq can be shown to converge 
to jj as L — > 00 by a similar argument. □ 

Next, we analyze a particular suboptimal switch, the uni- 
form switch. Since the uniform switch satisfies the sufficient 
condition in Theorem^! the convergence result holds. The next 
lemma presents its rate of convergence. 

Lemma 5: Consider an M-user discrete memoryless MAC. 
Let each real user have L virtual users and each switch be 
controlled by an i.i.d. random variable Si S {1, 2, L] with 
P(Si = k) = k = 1, ...,L. Define the error term e[L] = 

±I{X 1 ,X2, ...,X M ;Y)-Y:Ui rx ih .Then e[L] = O(i) for 
all i. 

Proof: In the uniform switch setting, P(Si = k) = for 
i = 1, ...,M and k — 1,...,L. Without loss of generality, we 
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examine the total throughput of real user 1. 

L 



fc=l 



fc=2 
k - 1 

L 



M-l 

E 



M-l-i 



I(X\] Y, X2, Xi + i) 



where I{Xv, Y, X 2 , X i+l ) = I{X X ;Y) for % = 0. 

We denote Rx ± — cqIq + ... + cm-\Im-\, where p is 
defined in the proof of Theorem for i > 0, and 



k=l 



k - 1 



M-l 



L 



for i > 1. Therefore, the error term can be calculated as 
follows, 



e\L] = 



M-l 



±I(X U X 2 ,...,X M ;Y)- * T i 

M-l , j 

X/ ( ~/u 



i=0 



< 



i=0 
M-l 

E 



q p 



i=0 

< M 



1 

M 





1 




max 


C; 




. 4 V 


M 





Note that x l (1 — x) M 1 1 is maximized at x 



M-l 



For 



i > 1, it can be verified that 

L-l 



1 L_1 



;=o 



1 - 



L 



+ 



M-l 

1 

> I x l {l~x) 




1 - 



M-l-i 



M-l-i -, 
z \ 1 



M - 1 

M-l-i , 

ax, 



L-l 

L ^ 

1=0 



L 



M-l-i 



M-l 

< f x'(l-x) 
Jo 



1 



M - 1 

M-l-i , 

ax. 



M-l-i 



Multiplying both sides of the above two inequalities by 
we have 



/M-l\ 



1 

M 



< 



M - 1 

i 



M - 1 



M-l 



M-l-i 



Therefore, 



< 



1 

c 

M 

M - 1 

i 



I, 



M - 1 



1 - 



M-l 



M-l-i 



I, 



1 

I 



= a v 

so e[L] < Ma4, where a > 0. For the term Co, a similar 
argument can be used to show that \cq — -y 1 ' 
e[L] = 0(i). 



< t-. Therefore, 

□ 



IV. Variations of Distributed Rate Splitting 

In Section |n] and Section |El] we imposed two symme- 
try constraints. The first is that the capacity region for the 
Gaussian MAC and the achievable rate region for the discrete 
memory less MAC are symmetric. The second is that users 
generate the same number of virtual users. In this section, 
we describe two variations of DRS. The first variation is 
presented in Section IIV-AI where we relax the symmetric 
region constraint. In this case, we show that as the number 
of virtual user per real user tends to infinity, the rate tuple 
achieved under DRS approaches a point on the dominant face. 
The second variation is presented in Section llV-BI where each 
real user may generate a different number of virtual users. The 
main advantage of this variation is that it can accommodate 
different user rate requirements in a distributed fashion. 

A. Asymmetric Capacity/Achievable Rate Region 

1) M-user Gaussian MAC: In this section, we consider 
the case where real users in a Gaussian MAC may have 
different transmission powers (i.e. the capacity region may 
not be symmetric). We assume that user i has transmission 
power Pi and the power vector (Pi, ...,Pm) is known to all 
users. We also assume that all real users split their powers 
into L virtual users according to the common power splitting 
rule defined by the vector (71,72, ...,7l), where 7^ > V/c 
and X)fe=i 7fc = 1- The power vector for the virtual users 
generated by user i is (71 Pi, ...,7LPi) for i = 1, ...,M. 

Lemma 6: For any real user with L virtual users, the unique 
way to maximize this user's throughput is to set 



7fe E|ii Pj \ N 



1 



N 



1 



for k — 1,...,L. Moreover, if all real users adopt this power 
allocation rule, then 



lim V* r lk = 

j — >r*~i * — " 



L — >oo 

fc=l 

for i = 1, ...,M. 




2Ef=i^ 



Proof: By replacing pj. by 7feP^ for k = 1, L, we can use 
arguments similar to those in Section||l]to prove the following: 
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FV 



Achievable Point 



{1, M} \ {i}. If maxfcgj! .. ^} — > as L — ► oo, then 



lim > 



fe=i 



M-l 



j=l V j ) 0CSC-! 

|S|=i 



M 



for t = 1, ...,M. 



Proof: We can replace ( M 7 l )l (X x ; Y, X 2 , X i+1 ) by 
E0c.sc— i |S|=j I i^i'i Xs) and use arguments similar to 
those for Theorem to prove the above lemma. □ 



Fig. 5. Achievable point for a two-user Gaussian MAC where user 1 has 
higher transmission power. The transmission powers and the achievable rates 
satisfy B = £L. 



1) Given a DRS scheme with L virtual users per real user, 
it is possible to strictly increase the throughput via an 
(L + 1) virtual user system. 

Under the optimal power split, all virtual users generated 
by real user i must have the same rate for i = 1, M. 
(Virtual users generated by different real users may have 
different rates.) 

For any real user with L virtual users, the unique way 
to maximize this user's throughput is to set 



2) 



3) 



Ik 



N 



1 



N 



)-[( 1 + 



1 



for k = 1,...,L. 
4) If all real users adopt this power allocation rule, then 

lim Y r lk = g log ( 1 + E % P M , 

for i = 1, ...,M 



□ 



We illustrate this achievable point on the dominant face for 
a two-user Gaussian MAC in Fig. [5] 

2) M-user Discrete Memoryless MAC: In Section HTll we 
considered the symmetric setting (cf (I18» : 

I(X S ;Y I A» =I(X T] Y I X T c), 

\/S,T C {1,...,M} such that |5| = \T\. In this section, we 
relax this constraint and consider an asymmetric achievable 
region. We require only that for V5,T C {1,2,...,M}, if 
SDT = 0, then I(X S ;Y) < I (X S ;Y\X T ). The M 
switches (Si, Sm) have probabilities P (Si = k) = X k for 
i = 1, M and fc = 1, ...,L, 

Lemma 7: Consider a general random switch controlled by 
Si, where P (Si = k) — Afe, k — l,...,L. Define —i 



11. Unequal Number of Virtual Users 

1) M-user Gaussian MAC: In this section, we retain the 
assumption that every user has the same transmission power P, 
but we do not require all real users to create the same number 
of virtual users. That is, user i and user j create Li and Lj 
virtual users independently, where Li may not be equal to Lj. 
The signal transmitted by a real user is the superposition of all 
its virtual users' signals. We also assume in this section that 
user i transmits the number Li in a header message to the 
receiver. The receiver receives the sum of Yli=i signals 
plus noise. We now describe a protocol which allows each 
user to split its power and set its rates independently, and 
allows the receiver to decode all virtual users one by one via 
a generalized successive decoding mechanism. Recall that for 
the Gaussian MAC, successive decoding works as follows. 
Users are decoded one after another regarding all other users 
that have not been decoded as interference, and the signals of 
decoded users are subtracted from the overall received signal. 

PROTOCOL 1: For user i, the power split and rate allocation 
rule are defined as follows: for k — 1, Li, 

-k 



Pik 



Tik 



N 
M 



1 



MPY 



1 



MPY 
~N~) 



1 



1 1 f 1 P* k 
5 log 1 + 7 



Pik 



N 



Note that the power split and rate allocation rule in PROTO- 
COL 1 are the same as that discussed in Section ITT1 

The generalized successive decoding algorithm is given by 
the following pseudo-program. Note that after a virtual user 
is decoded, its signal is subtracted from the overall received 
signal. 

decode virtual users (11, 21,..., Ml) in any order or in 
parallel. 

set p = (pii,p 2 i, —,Pmi) 

while (some virtual users are not decoded), 

Find the minimal element in p, say the ith entry; 
Decode the subsequent virtual user of user i; 
Update the ith entry of p: p(i) = p(i) + p, 
where p is the power of the virtual user 
being decoded in the previous step; 
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end 

Lemma 8: If all M users adopt the power split and the 
rate allocation rule described in PROTOCOL 1, then for any 
L t £ Z + , i = 1,2, ...,M, the decoder can decode all virtual 
users one by one following the decoding algorithm. 

Proof: By the rate allocation rule, ru = \ log(l + 
mp-p x+n ) f° r * = 1) •••) Thus, each of them can tolerate 
the maximum amount of interference plus noise, M P — pu + 
N. It is then easy to see that virtual users (11, Ml) can 
be decoded reliably in any order or in parallel. Now, we set 

P = (Pll, -,PMl). 

In the first run of the while loop, if pu is the minimum entry 
in p, the receiver decodes virtual user i2. By the rate allocation 
rule, r a = \\og{\ + M{P _ p p ^_ Pi2+N )- This implies that 
the maximum amount of interference plus noise that virtual 
user il can tolerate is M (P — Pn)—Pi2+N. However, the real 
amount of interference plus noise it faces is MP— 2~2j=i Pji ~~ 
Pi2 + N, which is smaller than or equal to what it can tolerate 
because Mpn < 2~2j=iPji- Therefore, virtual user i2 can be 
decoded reliably at the receiver. 

Suppose the decoding process succeeds in the tth run 
of the while loop. Now, p = (p\, ...,p^, f ). Let us consider 
the (t + l)th run of the while loop. Suppose the ith entry, 
p\, is the minimum entry in p. The receiver decodes the 
subsequent virtual user of user i, denoted by il. By the rate 
allocation rule, r u = \ log(l + mIp-^J^-pu+n )- ™ s 
implies the maximum amount of interference plus noise that 
virtual user il can tolerate is M(P — 2~2j<iPij) — Pu + N = 
M(P—pf)—pu +N. However, the real amount of interference 
plus noise it faces is MP — 2~2j=iPj ~ Pu + N, which is 
smaller than or equal to what virtual user il can tolerate 
because Mp\ < 2~2jLiPj- Therefore, virtual user il can be 
decoded reliably. Hence, the lemma follows by induction. □ 

To illustrate the decoding algorithm, let us carefully exam- 
ine a three-user example shown in Fig.|S] The shaded regions 
correspond to the virtual users (11, 21, 31), which are decoded 
in any order. Suppose we decode "11" first. By the rate 
allocation rule, ru — i log(l + 3P J' p 1 ^ 1+N ), which means the 
maximum amount interference plus noise that virtual user "11" 
can tolerate is 3P — Pii + N. This is exactly the amount 
of interference plus noise it faces. Therefore, "11" can be 
decoded reliably and we can subtract the signal of virtual user 
"11" from the overall received signal. Similarly, (21,31) can 
be decoded reliably and subtracted from the overall received 
signal. Now p = (pn,p2i,P3i)- The subsequent decoding 
order is illustrated by the numbers in Fig. [6] In the first 
run of the while loop, since p$i is the minimum in p, the 
receiver decodes virtual user "32". By the rate allocation 
rule, r 32 = |log(l + 3(P _ p3 ^!_ p32+jv ), which implies the 
maximum amount interference plus noise it can tolerate is 
3(P— P3i)— P32+N. However, the real interference plus noise 
it faces is (P -pu) + (P—P21) + (P — P31 —P32) +N, which 
is smaller than what it can tolerate since 2p^i < pu + P2i- So 
virtual user "32" can be decoded reliably and subtracted from 
the received signal. By searching for the minimum entry in p 
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Fig. 6. Three-user example to illustrate the decoding algorithm. The numbers 
correspond to the decoding order inside the while loop. 



in each run, we always decode a virtual user that can tolerate 
more interference than what it really faces. This assures the 
validity of our decoding algorithm. All of the other virtual 
users can be decoded in a similar fashion. 

By Lemma|2]and Lemma|8j user i can choose any Li £ 1 + , 
independently from other users, and have all virtual users de- 
coded reliably at the receiver. Therefore, user i can choose Li 
according to its own service requirement. For example, if user i 
wants to send low rate voice communication packets, it can 
set Li — 1, which corresponds to the basic CDMA scheme. If 
user i wants to send high rate stream video, it can set Lj equal 
to a large value in order to get higher throughput at the expense 
of higher coding complexity. Thus, this variation of DRS 
provides an explicit way for end users to trade off throughput 
and coding complexity, making differential rate requirements 
achievable in a distributed manner. Finally, Corollary |2] and 
Theorem |4] demonstrate the asymptotic optimality of this 
scheme and its rate of convergence. 

2) M-user Discrete Memoryless MAC: In this section, we 
describe a variation of the DRS scheme for the discrete mem- 
oryless MAC which supports differential rate requirements 
to end users in a distributed manner. In this scheme, we 
adopt the uniform switch, but we do not require every user 
to have the same number of virtual users. We split by means 
of M independent switches. Without loss of generality, let us 
consider user i. If user i has Li virtual users, then switch i 
has Li inputs, Xik £ Xi for k = 1, and one output 

Xi £ Xi. Switch i is controlled by a uniform random variable 
St £ {1, ...,Li} with P(S l = k) = i for k = 1, The 
output is given by: Xi = Xik, if Si = k. 

We now describe the protocol for the discrete memoryless 
MAC which allows user i to choose Li independently. We 
show the asymptotic optimality of this variation of DRS under 
the protocol. 

PROTOCOL 2: For user i with L{ virtual users, the switch i 
is controlled by a uniform random variable Si where P(5j = 
k) = j- for k = 1, The rate allocation rule is defined 

as follows: 




13 



1 



k-l 



M-l-l 



I(X 1 ;Y,X 2 ,..,X l+1 ) 



The decoding algorithm is given by the following pseudo- 
program. Note that after a virtual user is decoded, its signal 
is used as side information to aid the decoding process of 
subsequent virtual users. 

decode virtual users (11, 21,..., Ml) in any order or in 
parallel. 

while (some virtual users are not decoded), 

Find the minimal element in s, say the ith entry; 
Decode the subsequent virtual user of user i; 
Update the ith entry of s: s(i) — s(i) + j-; 

end 

Lemma 9: If all M users adopt the rate allocation rule in 
PROTOCOL 2, then for any L, e Z+ Vi, the decoder can 
decode all virtual users one by one following the decoding 
algorithm. 

Proof : Virtual users (11, 21, .... Ml) can be decoded in any 
order if and only if rxu < I(Xn ; Y, Sf 1 ) for all i. This is true 
because under our rate allocation rule, rx n = j-I(Xi; Y) = 
■tj{X*Y) = I(X a ;Y,Sf ). We set s = (£, .1, ' 

In the first run of the while loop, if j- is the minimum 
entry of s, the receiver decodes virtual user i2. By the rate 
allocation rule 

M-l 



r X i: 



1 

L~ 



i-i-) nxc.Y) 



M-l 

E 

1=1 



M — l\ / 1 x ' 

I J \u 

M-l-l 

I{Xi; Y, X 2 , ..,Xi + i] 



(27) 



Virtual user i2 can be decoded reliably if rx i2 < 
I(Xi2\ Y, Si , Xn, Xmi)- This mutual information can be 
simplified in the same way as described in equations d23t - 
d26l . Recall the definition -i = {1, M} \ {i}. 



'Ml 



I [Xi2\ Y, Sf f , Xn, X]\ 
^I(X i2 ;Y,X 11 ,...X M1 \S. i ) (28) 

^J2 P ( S -i= S -i) I ( X ^ Xl ^-' 



Xmi |S_i — s_i ) . 



(29) 



We can verify that the I{X\\ Y) term in Ml\ is less than or 
equal to the corresponding I(Xi\Y) term in Equation \29\ . 
This follows from 

P (Si > 1, St-i > 1, S l+1 > 1, ...S M > 1) 



> 



M-l 



since -j- < j- for all j 7^ i. Similarly, it can be verified 
that the second term in \21\ is less than or equal to the 
corresponding term in Equation \29\ . Therefore, virtual user %2 
can be decoded reliably. 

Suppose the decoding process succeeds in the fth run of 
the while loop. Now, s — (s\, s M ). Let us consider the 
(t + l)th run of the while loop. Suppose the ith entry, s\, is 
the minimum entry in s. The receiver decodes the subsequent 
virtual user of user i, denoted by ij. By the rate allocation 
rule 

M-l 



T ^ 3 



1 



1 - 



3-1 



i(x i; y) 



1=1 



Li 



I J V U 

M-l— ! 



I(X i; Y,X 2 ,..,X l+1 ) 



Again, we can simplify the mutual information 



J(Xy- ; r,Sf ,X{~ ,...,X J m ) and show that it is great 
than or equal to rxy» which implies that virtual user ij can 
be decoded reliably. Hence, the lemma follows by induction. 

□ 

Let us illustrate the decoding algorithm by the following 
example. We consider a two-user discrete memoryless MAC 
where user 1 creates 2 virtual users and user 2 creates 3 virtual 
users. Random switch 1 is controlled by Si where P(S± = 
1) = P(Si = 2) = i, and random switch 2 is controlled 
by S 2 where P(5 2 = k) = § for k = 1,2,3. By the rate 
allocation rule, the virtual users' rates can be simplified as 
follows 



r x 12 
r x 21 

r x 23 



\l{Xi,Y) 

\ ^I(X 1 ;Y) + ^I(X 1 ;Y,X 2 ) 



I(Xi;Y) 
h(X i; Y) + ±I(X i; Y,X 2 ) 

±I(X i; Y) + h(X i; Y,X 2 ) 



We first decode (11,21) in any order. Suppose we decode 
"21" first. Virtual user "21" can be decoded reliably if rx 21 < 
/ (X 2 i; Y, Si, S 2 ). The condition holds because 



I (X 2 i; Y, Si, S 2 



= I (X 21 ;Y, Si\S 2 ) 

= l -I(X 21 ;Y\S 2 = l) 

= \l{X 2 ;Y) 

= \l{Xi;Y) 

= r x 21 

Virtual user "11" can be decoded similarly. Now, we set s 
(- -) 

\2> 3'' 
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In the first run of the while loop, the receiver decodes "22" 



< 



Let us calculate the mutual information between 



X 22 and Y given Si,S 2 and previously decoded Xn,X 21 . 



i (x 22 ; y, Si,s 2 , Xu, x 2 i) 

= -^I (X 22 ; Y\Si, Xu, X21, S 2 — 2) 
= \(] 1 I{X 2] Y,X 1 ) + ] i I(X 2 -Y) 

= \(] 1 I{X 1] Y,X 2 ) + ] i I(X 1 -Y) 

> ^(^I(X 1 -Y,X 2 ) + h(X 1 ;Y) 



The third equality is due to our symmetric assumption. There- 
fore, virtual user "22" can be decoded. By searching for the 
minimum entry in s in each run, we always decode a virtual 
user whose rate is smaller than or equal to the corresponding 
mutual information. This guarantees the correctness of our 
decoding algorithm. Virtual users (12, 23) can be decoded 
reliably at the receiver in a similar fashion. The asymptotic 
optimality of this scheme in the discrete memoryless MAC 
can be demonstrated by Theorem 

V. Concluding Remarks 

In this paper, we take an information-theoretic approach to 
the problem of distributed multiple-access communication. We 
present a Distributed Rate Splitting scheme whereby each real 
user creates a number of virtual users and all virtual users are 
successively decoded at the receiver. One possible advantage 
of Distributed Rate Splitting is that it can be implemented with 
lower complexity when compared with joint coding schemes, 
and less coordination among users when compared with either 
time-sharing or rate splitting. For the symmetric M -user Gaus- 
sian MAC, each real user creates the same number of virtual 
users via a power/rate splitting mechanism. The transmitted 
signal of a real user is the superposition of all its virtual users' 
signals. For the symmetric A/-user discrete memoryless MAC, 
each real user creates the same number of virtual users via a 
random switching mechanism, and the transmitted signal of a 
real user is determined by a random switch. All virtual users 
are successively decoded at the receiver. It is shown that DRS 
can achieve the maximum equal rate point for both channel 
models as the number of virtual users per real user tends to 
infinity. Finally, we present two variations of the DRS scheme. 
For the case of asymmetric capacity regions, we show that a 
point on the dominant face can be achieved asymptotically. 
For the case of an unequal number of virtual users, we show 
that different user rates requirements can be accommodated 
independently in a distributed manner. 

Appendix I 
Proof of Theorem|2] 

Proof: We use induction on the number of virtual users. 
For L = 2, the original problem reduces to: SIRi (pi,p 2 ) = 



SIR2 {pi,P2) subject to pi + P2 = P and pi,p 2 > 0. The 
unique solution is 

(pt(P),p* 2 (P)) = f-L(N + MP-y/N(N + MP)) , 



M 

For L = j — 1, suppose (pl(P), ...,p*_ 1 (P)) uniquely solves 
SIR 1 (p 1 ,...,p j - 1 ) = ... = SIR 3 -i{pi,...,p 3 -i) for any 
P > 0, subject to Ylk^iPk — P and p^ > for fc = 
1, 2, ... j — 1. Let us consider the j virtual users case. Given any 
tuple (pi, ...,pj) such that 5Zfe=i Pk = P an d Pk > for k = 
1, 2, .., j, we can fix pj, so p\ + ... +fj-i = P — Pj- We now 
solve 

SIRi (pi, ...,Pj_i) = ... = SIRj-i {pi, ...,Pj-i) (30) 

subject to J2k=iPk = P~Pj> Pk > for k=l, 2, .., j. For fixed 
Pj, by the induction hypothesis, we have a unique solution 
{p\{P — Pj), ---'Pj-iiP — Pj)) which solves equation OOt. 

Let s* ( Pj ) 4 SIRi-! (pt {P - Pj ) , ...,?*_! (P - P j)) = 

{m-i)^(7-p 3 )+n - We are able to verif y that s *(pj) 

is a strictly decreasing function of pj, and SIRj(pj) 
= (m-i) p -+n i s a strictly increasing function of pj. 
Moreover, the function values at boundary points satisfy 
s* (0) > SIRj (0) and s* (P) < SIRj (P). So there exists 
a unique p* such that SIRj (p*) — s* (p*). Hence, we 
conclude (p* (P - p*) , ...,_p*_x [P - p*) ,pf) is the unique 
solution to the j virtual users case. The theorem follows by 
induction. □ 
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